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Abstract. 

A standard approach to model reduction of large-scale higher-order linear dynamical 
systems is to rewrite the system as an equivalent first-order system and then employ 
Krylov-subspace techniques for model reduction of first-order systems. This paper 
presents some results about the structure of the block-Krylov subspaces induced by 
the matrices of such equivalent first-order formulations of higher-order systems. Two 
general classes of matrices, which exhibit the key structures of the matrices of first- 
order formulations of higher-order systems, are introduced. It is proved that for both 
classes, the block-Krylov subspaces induced by the matrices in these classes can be 
viewed as multiple copies of certain subspaces of the state space of the original higher- 
order system. 
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1 Introduction. 

In recent years, Krylov-subspace methods, especially the Lanczos algorithm 
and the Arnoldi process, have become popular tools for model reduction of large- 
scale time-invariant linear dynamical systems; we refer the reader to the survey 
papers 003121 Eh and the references given there. Krylov-subspace techniques can 
be applied directly only to first-order linear dynamical systems. However, there 
are important applications, for example in VLSI circuit simulation |191 11UI ITT) . 
structural dynamics ^J|SJE], and computational electromagnetics (22], that 
lead to second-order, or even general higher-order, linear dynamical systems. 

The standard approach to employing Krylov-subspace methods for model re- 
duction of a second-order or higher-order system is to first rewrite the system 
as an equivalent first-order system, and then apply Krylov-subspace techniques 
for reduced-order modeling of first-order systems. At first glance, there are two 
disadvantages of this standard approach. First, the second-order or higher-oder 
structure is not preserved by a straightforward application of Krylov-subspace 
methods to the first-order formulation. Second, the computational cost increases 
due to the fact that the state-space dimension of the first-order formulation is 
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/ times the state-space dimension of the original Z-th-order system. A partial 
remedy of the first problem is to use certain structure-preserving projections, 
as described in the recent papers [221 [03 123 El ED • However, the structure- 
preserving property of these approaches comes at the expense of reduced ap- 
proximation quality of the resulting models. To address the second problem, at 
least for the special case of second-order systems, various authors have proposed 
to directly generate basis vectors of certain subspaces of the state space of the 
second-order system, rather than basis vectors of the Krylov subspaces of the 
first-order formulation; see, e.g., |H1 1141 IT71 1181 124j . 

The purpose of this paper is to shed some light on the second problem and 
to present some results on the special structures of the block-Krylov subspaces 
induced by the matrices of equivalent first-order formulations of general higher- 
order time-invariant linear dynamical systems and of certain systems of first- 
order integro-differential-algebraic equations. More precisely, we introduce two 
classes of structured matrices, which include the matrices of these first-order for- 
mulations as special cases. As our main results, we show that the block-Krylov 
subspaces induced by the matrices in theses classes exhibit special structures. 
Roughly speaking, for both classes, the associated structured block-Krylov sub- 
spaces consist of multiple copies of certain subspaces of the state space of the 
original higher-order system. 

The remainder of the paper is organized as follows. In Section [21 we briefly 
review the notion of block-Krylov subspaces. In Section [3J we introduce two 
classes of matrices, and we state our main results about the special structures of 
the block-Krylov subspaces associated with these two classes. In Section 0] we 
present proofs of these main results. In Sectional we consider higher-order linear 
dynamical systems, and we show how certain mo del- reduction approaches lead 
to matrices that are special instances of the first class of matrices introduced 
in Section [3 In Section [BJ we study systems of first-order integro-differential- 
algebraic equations, and we show how model reduction leads to matrices that are 
special instances of the second class of matrices introduced in Sectional Finally, 
in Section we make some concluding remarks. 

Throughout this paper the following notation is used. The set of real and 
complex numbers is denoted by E and C, respectively. Unless stated otherwise, 
all vectors and matrices are allowed to have real or complex entries. For a matrix 
A = [a,jk } e C mxn , we denote by A H := [3jy ] G C nxm its conjugate transpose. 
For any two matrices A — [ctjk] G C mx " and B G C pxq , 

A®B:= [a 3k B] G C mpxnq 

is the Kronecker product [23 [201 of A and B. The n x n identity matrix is 
denoted by I n and the zero matrix by 0. If the dimension of I n is apparent from 
the context, we drop the index and simply use /. The actual dimension of will 
always be apparent from the context. 
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2 Block-Krylov subspaces. 

We use the notion of block-Krylov subspaces that was introduced in £Q in 
connection with a band Lanczos process for multiple starting vectors. In this 
section, we briefly review the definition of block-Krylov subspaces from pQ. 

In the following, let 

(2.1) MeC NxN and K=[n r 2 ••• r m ]eC Nxm 
be given matrices. The N x mN matrix 

(2.2) [K MTZ M 2 TZ ••■ M 1 *- 1 ^,] 
is called the block-Krylov matrix induced by M. and TZ. 

2.1 The case of exact deflation. 

Let Nq (< N) denote the rank of the block-Krylov matrix (|2.2(l . Hence only No 
of the mJV columns of l|2.2|l are linearly independent. Such a set of No linearly in- 
dependent columns can be constructed by scanning the columns of (|2.2|l from left 
to right and deleting each column that is linearly dependent on earlier columns. 
This process of deleting linearly dependent columns is called exact deflation. By 
the structure of the block-Krylov matrix l|2.2|l . a column M k ~ 1 ri being linearly 
dependent on earlier columns implies that all columns M. 3 Ti, k < j < N — 1, 
are also linearly dependent on earlier columns. Consequently, applying exact 
deflation to (|2.2() results in a matrix of the form 

(2.3) V(M,K) := [Hi MTZ 2 M 2 TZ 3 ■■■ M k °- l K ko ] e C NxN ". 

Here, for each k = 1, 2, . . . , fc , K k £ C Nxmk is a submatrix of U k -i £ C Nxmk - 1 : 
with TZk ^ TZk-i if, and only if, exact deflation occurs within the fc-th Krylov 
block A4 k ~ 1 lZ in (|2.2|l . (For k = 1, we set IZo = TZ and too = m.) For later use, 
we remark that 

(2.4) TZ k =1l k - l E k , E k eC m "-^ mk , m k <m k - x , 

where E k is the deflated identity matrix obtained from I mk _ 1 by deleting those 
mfc_i — m k columns corresponding to exact deflation within the fc-th Krylov 
block. 

By construction, the matrix (|2.3I) has full column rank No. For 1 < n < No, 
the n-th block-Krylov subspace (induced by M and TZ), jC n (M,7Z), is defined as 
the n-dimensional subspace of spanned by the first n columns of H2.3J) . We 
say that 

V = [ Vl V2 ••• v No ]eC NxN ° 
is a basis matrix of the block-Krylov subspaces induced by M. and TZ if 

K, n {M, TZ) — span [v\ v 2 ■■■ v n ] for all n = 1, 2, . . . , Nq. 
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Note that the matrix V(A4, 1Z) defined in (|2.3|) is a particular instance of a basis 
matrix. Furthermore, any two basis matrices Vi and V2 of the block-Krylov 
subspaces induced by M. and 1Z are connected by a relation of the form 

(2.5) V l =V 2 U 1 

where U is a nonsingular and upper triangular matrix. 

Lanczos- and Arnoldi-type algorithms for the actual construction of basis ma- 
trices of block-Krylov subspaces can be found in PP and [§]. 

2.2 Inexact deflation. 

In the above construction of block-Krylov subspaces, we performed only exact 
deflation. In an actual algorithm for constructing a basis matrix of the block- 
Krylov subspaces induced by M. and 1Z in finite-precision arithmetic, one also 
needs to delete vectors that are in some sense "almost" linearly dependent on 
earlier vectors. The deletion of such almost linearly dependent vectors is called 
inexact deflation. For example, the Lanczos- and Arnoldi-type algorithms in £Q 
and [H] have simple built-in procedures for both exact and inexact deflation. 

It turns out that the construction of block Krylov subspaces described in 
Subscction l2 . II can be extended to the more general case when exact and inexact 
deflations are performed. The deflated matrix i|2.3[l is now obtained by deleting 
from the block-Krylov matrix (|2.2(l those columns that are linearly or almost 
linearly dependent on columns to their left. In the general case, No is now simply 
defined as the number of columns of the resulting deflated matrix l|2.3|> . Note 
that No is less than or equal to the rank of the block-Krylov matrix (|2.2|) , with 
equality only if no inexact deflation occurs. Based on the deflated matrix l|2.3[l . 
block-Krylov subspaces and basis matrices of these subspaces are defined in the 
same way as in Subsection 12.11 However, note that the resulting block-Krylov 
subspaces are in general different from the block-Krylov subspaces obtained with 
exact deflation only. 

The main results of this paper, namely Theorems 13 . II and 13 . 21 below, hold true 
for the general case of exact and inexact deflations, provided that the matrices 
IZk in H2.3JI still satisfy relations of the form (|2.4(l . This is the case for the built-in 
deflation procedures of the Lanczos- and Arnoldi-type algorithms in pQ and [§]. 
Thus, in the following, we always assume that the matrices IZk in l|2.3|l indeed 
satisfy relations of the form 12.4(1 . 

3 Main results. 

In this section, we introduce two classes of matrices M. and 1Z, and we state 
our main results about the special structures of the block-Krylov subspaces as- 
sociated with these two classes. Proofs of these results are given in Section 0] 
below. 
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3.1 Case I. 

In this subsection, we assume that the matrices <|2.1[) are of the form 



(3.1) 
where 

(3.2) 



M = (c®7„ ) [M« J|f( J ) 
72. = c ® i?, 



AfW e c n ° xn °, i = 1,2,..., i, i? e 



Cl 
C2 

ci 



and S 



Oil Cl2 
021 022 

0'n 0/2 



"mo X m 

01i 
02/ 

Oil 



ilXl 



We assume that 
(3.3) 



c 2 ^0, » = 1,2,. 



Note that M e C^^ and K £ C*™, where 
(3.4) N := ln . 

Our main result about the structure of the block-Krylov subspaces associated 
with the class of matrices l|3.1fl is as follows. 

Theorem 3.1. Let M and 1Z be matrices of the form \3.1\ and Ij^.g!) . and 
assume that $3.3\ is satisfied. Let V G C NxN ° be any basis matrix of the block- 
Krylov subspaces induced by M. and 1Z. Then, V can be represented in the form 

■ 1,2,..., I, U® G C^ *^ is nonsingula 



(3.5) 



V = 



where W G C n " xN ° and, for each i 
and upper triangular. 
The result of Theorem l3.1l can be interpreted as follows. Let 

(3.6) :=span[ti;i w 2 ■•• w n ] C C n ° , n = 1, 2, . . . , N , 

denote the sequence of subspaces spanned by the leading columns of the matrix 

(3.7) W=[w 1 w 2 ■■■ w No ]eC n ° xN ". 

In view of l|3.5|) . for each n — 1,2, ...,Nq, the n-th block-Krylov subspace 
fcniMjH), even though it is a subspace in C , consists of I 'copies' of the 
same subspace S n , which is a subspace of only C™°, where, by (|3.4II . no = N/l. 
We stress that, in general, S n is not a block-Krylov subspace. 
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3.2 Case II. 

In this subsection, we assume that the matrices <|2.1[) are of the form 



M 



(3.8) 



K = 



£7« 

cm 

£7(i) 
C7(2) 

£7(0 



•Jlf(i) A/W 



M(0' 


















Clin, 



B. 



where 
(3.9) 



£7(i) g C n,Xno 

and ReC n ° xm . 
Note that X G C NxN and ft £ C Nxm , where 

TV := ni + n 2 + ■ ■ ■ 



<Ti G 



1,2,. 



Our main result about the structure of the block-Krylov subspaces associated 
with the class of matrices (|3.8|l is as follows. 

Theorem 3.2. Let M and 1Z be matrices of the form {HSj) an d {221 ■ Let V G 

C NxN ° be any basis matrix of the block-Krylov subspaces induced by Ai and TZ. 
Then, V can be represented in the form 



(3.10) 



V 



C (2) WU (2) 



where W G C n ° xN ° and, for each i=l,2,...,l, U {i) G C" ^ 1 is nonsingular 
and upper triangular. 

The result of Theorem 13.21 can be interpreted as follows. Let S n C C n ° , 
n = 1,2,..., A^o, again denote the sequence of subspaces spanned by the leading 
columns of the matrix W; as defined in Ij3.6|l and (|3.7(l . In view of (|3.1()(l . for 
each n = 1, 2, . . . , No, the n-th block-Krylov subspace K. n (Ai, TV), even though 
it is a subspace in C^, consists of I 'copies' of the -multiples, i = 1,2, ... ,1, 
of the same subspace S ni which is a subspace of C"°. 



4 Proofs 

In this section, we present proofs of Theorems 13.11 and 13.21 
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4-1 Proof of Theorem \3.1\ 

Let V be a given basis matrix of the block Krylov subspaces induced by M 
and 1Z. We need to show that there exists a matrix W and nonsingular upper 
triangular matrices i — 1,2, . . . , I, such that l|3.5jl holds true. 

Recall that any two basis matrices are connected by a relation of the form 1)2. 5JI . 
where U is a nonsingular and upper triangular matrix. Therefore, without loss 
of generality, we may assume that 

(4.1) V = V{M,K) 

is the particular basis matrix defined in i|2.3[) . Furthermore, we partition any 
possible candidate matrices W and 17 w, i = 1,2, ... , Z, according to the block 
sizes of V(M,1Z) in J23J|. More precisely, we set 

W = [Wi w 2 ■■■ w ko ], 



(4.2) 



U(i) 



Tj(i) Tj(i) 
u ll u 12 



U 



(0 
lk 



u. 







(0 
22 



J7 



(■0 



i=l,2,. 



with subblocks W k G C n ° xm ' and nonsingular upper triangular diagonal blocks 
1^2 6 C" 1 **" 1 * for all i = 1, 2, — , i and k = 1, 2, . . . , fc . Inserting EH) 
and l|4.2|l into (|3.5|) . it follows that the desired relation (|3.5I) holds true if, and 
only if, 



(4.3) 



(2) 



r(0 



fe = l,2,. 



, fc . 



Therefore, it remains to construct the subblocks in (|4.2|) such that 1)4. 3 [I is sat- 
isfied. To this end, we define these subblocks recursively as follows. 
For each k = 1, 2, . . . , ko, we set 



(4.4) 



U, 



(i) 



jk 



,k-l, 



k 7 mfc , 



for j = fc, 



for all i = 1, 2, . . . , I, and 

REi, 



if fc = 1. 



(4.5) 



>k-l 



1 \J'=1 
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Here, the matrices Ek are the ones from ((2.41) . We remark that, in view of 
assumption 13.3(1 . the subblocks uj^ m (|4.4I) are all nonsingular. Moreover, 
they are all diagonal and thus, in particular, upper triangular. 

Using induction on fc, we now show that the subblocks ((4.4(1 and 14.5(1 indeed 
satisfy 1(4.3(1 . Recall from ((3.1(1 that 71 = c ® R and from ((2.4(1 (for k = 1) that 
Tlx = TZE 1 . Together with the definitions of Jj[f, i = 1, 2, . . . , I, in g3J> and of 
Wi in 1(4.5(1 . it follows that 



~ c x RE x ~ 
c 2 RE x 




'WxU^' 


. ciRE\ _ 




_WiU$_ 



This is just 1(4.3(1 for k = 1. Let 1 < fc < fco and assume that 1(4.3(1 holds true for 
fc — 1. Then, by multiplying the relation ((4.3(1 (with fc replaced by fc — 1) from 
the left by the matrix Ai from 1(3.1(1 . it follows that 



M^Kk-i = M[M k - 2 K k -i 



i \j=i 




EL^E-iV^w 



EL^E^^S-x 

Multiplying this relation from the right by the matrix E^ from ((2.4(1 and using 

the definitions of TjQ , i = 1, 2, . . . , Z, j = 1, 2, . . . , k, in 1(4.4(1 and of Wfc in 1(4.5(1 . 
we obtain 

TW*- 1 ^ = M^TZk-xEk 



EU w i U ik 



This is just the desired relation 1(4. 311 . and thus the proof of Theorem 13.11 is 
complete. 



4-2 Proof of Theorem 

We proceed in the same fashion as in Subsection 14.11 Again, without loss of 
generality, we assume that the basis matrix V in ((3.1U|) is given by ((4.1(1 . and 
we partition the matrices W and f/W, i = 1,2, ... ,1, as in 1(4.21) . Inserting ((4.1|) 
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and l|4.2|l into (|3.1U|) , it follows that the desired relation (|3.1U|) holds true if, and 
only if, 



(4.6) 



l,2,...,fc . 



Therefore, it remains to construct the subblocks in (|4.2|) such that 14.6fl is sat- 
isfied. To this end, we define these subblocks recursively as follows. 
For k = 1, 2, . . . , ko, we set 



U 



(4.7) 

for all i = 1, 2, . . . , I, and 



aiUfl^Ek, for j = 1,2,. 
I-mu, for j = fc, 



1. 



REi, 



(4.8) 



VK fc := 



/fe-i 



: i \i=i 




Here, again, the matrices Ek are the ones from H2.4J1 . 

Using induction on fc, we now show that the subblocks (|4.7I) and 14.81) indeed 
satisfy (|4.6|l . Recall that TZ is of form l|3.8|) and that, by 12.4|l (for fc = 1), 



IZi = 1ZE\. Together with the definitions of U\± , i = 1, 2, . 
Wx in |g3J), it follows that 



, I, in (|4.7|l and of 





"(7(1)- 










Tlx = 




(REi) = 









This is just Ij4.6|l for fc = 1. Let 1 < fc < fco and assume that l|4.6|) holds true for 
fc — 1. Then, by multiplying the relation (|4.6|l (with fc replaced by fc — 1) from 
the left by the matrix Ai from l|3.8|l . it follows that 



(M^Kk-x) 



/fc-1 



1 \J=1 
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Multiplying this relation from the right by the matrix E k from (|2.4[1 and using 
the definitions of Tjf k \ i = 1, 2, . . . , I, j = 1, 2, . . . , k, in (12) and of W k in JOJ, 
we obtain 



M k - l n k -xE k 

cww k ug> 



a) 



(0 



c (1) E?=i 



(2) 



This is just the desired relation l|4.6|l . and thus the proof of Theorem 13.21 is 
complete. 



5 Matrices arising in higher-order linear dynamical systems. 

In this section, we show how block-Krylov subspaces !C n (Ai, 1Z) with matrices 
A4 and TZ of the form l|3.1f) arise in the context of higher-order linear dynamical 
systems. 

5.1 General time-invariant linear dynamical systems. 

We consider general higher-order multi-input multi-output time-invariant lin- 
ear dynamical systems. We denote by m and p the number of inputs and out- 
puts, respectively, and by / the order of such systems. In the following, the only 
assumption on m, p, and / is that to, p, I > 1. 

An m-input p-output time-invariant linear dynamical system of order I is a 
system of differential-algebraic equations (DAEs) of the following form: 



(5.1) 



dt l y ' '~ l dt l 

d 1 ' 1 d 
y(t) = Du(t) + Li-i-j^xit) + ■■■ + Lx—x{t) + L x(t). 



dt 

d 
~dt 



>, < i < I, B e C"° xm , D e C pxm , and L 3 £ 



Here, P t E C" 

< j < I, are given matrices, and no is called the state-space dimension of (|5.1|l . 
Moreover, in H5.ll) . u : [t , oo) i— » C m is a given input function, t S R is a given 
initial time, the components of the vector-valued function x : [to,oo) t— > C™° are 
the so-called state variables, and y : [to,oo) i— > C p is the output function. The 
system is completed by initial conditions of the form 



(5.2) 



dti 



x(t) 



So) 



< j < I, 



t=t 



(i) 

where x ' € C n °, < j < I, are given vectors. 
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We stress that the matrix Pi is allowed to be singular, and thus the first 
equation in (|5.1I) is indeed a system ol DAEs in general. Our only assumption on 
the matrices Pj, < i < I, in l|5.1|) is that the no x n -matrix- valued polynomial 

(5.3) P(s) :=s l Pi+s l - 1 Pi- 1 + --- + sPi+P , seC, 

is regular, i.e., the matrix P(s) is singular only for finitely many values of s £ C; 
see, e.g., [12 Part II]. 

5.2 Equivalent first-order formulation. 

It is well known (see, e.g., JI2J Chapter 7]) that any Z-th-order system ()5.1|) 
(with state-space dimension n ) is equivalent to a first-order system with state- 
space dimension N :— ln . Indeed, it is easy to verify that the Z-th-order sys- 
tem (|5.1|l with initial conditions l|5.2|) is equivalent to the first-order system 



(5.4) 



S— z(t) -Az(t) = Bu(t), 
at 



y(t) = Vu(t)+Cz(t), 
z (to) = z 0i 



where 



z{t) 



x(t) 




r r (0) 1 






T (i) 

Xq 






L df- 1 x W - 




(l-l) 

LX J 



(5.5) 



C:=[L L% 



Li-i 



B 



V := D. 



£ := 



I 

/ 

••■ 

••■ 












Pi 



A 



I 



■•■ 
Po Pi P2 ■■■ 





-/ 

Pl-l 



and I = I no is the uq x hq identity matrix. 

It is easy to see that, for any given s £ C, the matrix s £ — A is singular if, and 
only if, the matrix P(s) defined in 1)5. 3J) is singular. Therefore, our assumption 
on the regularity of the matrix polynomial (|5.3|l is equivalent to the regularity 
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of the matrix pencil s £ — A. This guarantees that the matrix s £ — A is singular 
only for finitely many values of s G C, and that 

(5.6) H(s) :=V + C(s£-Ay 1 B, s € C, 

is a well-defined p x m-matrix-valued rational function. We remark that Ij5.6[l is 
called the frequency-domain transfer function of (|5.4(l . 

5.3 Pade-type model reduction. 

A reduced-order model of (|5.4I) is a linear dynamical system of the same type 
as <|5.4[l . but with reduced state-space dimension, say n, instead of the original 
state-space dimension N. More precisely, a reduced-order model of (|5.4|l with 
state-space dimension n is a system of the form 

£ n ^rz(t) - A n z(t) =B n u(t), 
(5-7) y( t ) = V n u{i) + C n z(t), 

z(t a ) = z Q , 

where An, £ n £ C" x, \ B n £ C" xm , V n e C pxm , C n £ C pxn , and S £ C". 
The problem of model reduction then is to construct data matrices A ni £ n , B ni 
U n , and C n such that (|5.7(l is a good approximation of the original system Ij5.4|l , 
even for n <C N. 

A possible approach, which is intimately related to block-Krylov subspaces, is 
Pade and Pade-type model reduction; see, e.g., IHim and the references given 
there. Let so 6 C be a suitably chosen expansion point, and in particular, let 
so be such that the matrix so £ — A is nonsingular. The reduced system (|5.7(l is 
said to be an n-th Pade model of the original system Ij5.4|l if the reduced-order 
transfer function 

H n (s) := V n + £ n (s£ n - A n ) B n , s e C, 

and the original transfer function (|5.6|l . H, agree in as many leading Taylor 
coefficients about the expansion point sq as possible, i.e., 

(5.8) H n (s)=H(s) + O((s-s )«W), 

where q(n) is as large as possible. While Pade models are optimal in the sense 
of H5.8fl . in general, they do not preserve other desirable properties of the original 
system. Preserving such properties is often possible by relaxing (|5.8|) to 

(5.9) H n (s)=H(s) + O({s-s y), 

where q < q(n). The reduced system Ij5.7ll is said to be an n-th Pade-type model 
of the original system (|5.4(l if a property of the form l|5.9|l is satisfied. 
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Both ra-th Pade and Pade-type models can be generated via Krylov-subspace 
machinery; see, e.g., E] an d the references given there. To this end, the 
original transfer function (|5.6|) is rewritten in the form 



H(s)=V + C(l+{s-s )M) TZ, 

where 

(5.10) M := (s £-A)~ 1 £ and K := (s £ - A) ~ X B. 

Pade-type models are then obtained by projecting the data matrices in (|5.4|) 
onto the block-Krylov subspaces K, n {Mc : TVj induced by the matrices Q5.1Up . 
Similarly, Pade models can be generated via two-sided projections involving the 
right and left block-Krylov subspaces K. n (M,lZ) and K, n (M H , C H ) . 

5.4 Structure of the matrices Ai and 1Z. 

Recall that, in this section, we are concerned with general Z-th-order systems 
of the form (|5.1|) . In this case, the matrices A, £, and B in (|5.1U|) are the ones 
defined in (|5.5|l . Furthermore, the expansion point so G C in (|5.10|l is such that 
the matrix sq £ — A is nonsingular, or, equivalently, the matrix 



(5.11) P( So ) = 4r + 
Next, we set 



sqPi + Pa is nonsingular. 



(5.12) 



M« := (P(s )) 



-1 \ -> 



3=0 



1,2, 



and 

(5.13) R := (P(s ))~ 1 B. 

Using the definitions of A, £, and B in H5.10fl . together with (|5.12|) and 15.13|l . 
one can show that the matrices l|5.10|) have the representations 



M = 



(5.14) 



s M^ 



SqM^ 



s 1 q - 2 mw 4- 2 m( 2 ) 4- 2 m( 3 ) 



s MW 





In 



so I, 
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and 



(5.15) 



K = 



b Q l no 



R. 



J-l ; 



Proofs of H5.14fl and l|5.15|l are given in Appendix A. 

Note that the matrices M. and 1Z in l|5.14|l and (|5.15() are a special instance 
of the class of matrices l)3.1|l , with c and £ given by 



so 



J-i 



and £ := — 



••• 

1 '■• 

so 1 



J-2 



so 



1 



Furthermore, provided that sq ^ 0, the assumption on c in (|3.3|l is satisfied. We 
remark that for the case sq — 0, M. reduces to a block companion matrix, and 
1Z reduces to a multiple of the first block unit vector. We do not consider this 
case, which is fundamentally different from the case sq 0, in this paper. 



6 Matrices arising in first-order integro-DAEs. 

An important special case of (|5.1|l is second-order systems, that is, I = 2 
in (|5.1|) . For example, second-order systems arise in structural dynamics |16l 151 
I18| . circuit analysis ^5J Chapter 3], and computational electromagnetics 
However, in some of these applications, a more suitable formulation of such sys- 
tems is as systems of first-order integro-differential-algebraic equations (integro- 
DAEs). For example, this is the case for passive systems such as RCL electrical 
circuits consisting of only resistors, capacitors, and inductors; see, e.g., |15l 
Chapter 1], |SJ Chapter 2], and |1U1 111). In this section, we show how block- 
Krylov subspaces K, n (M,lZ) with matrices M. and 1Z of the form (|3.8|l arise in 
the context of such systems of first-order integro-DAEs. 

6.1 Systems of first-order integro-DAEs. 

We consider m-input p-output systems of first-order integro-DAEs of the fol- 
lowing form: 

d /"* 
Pi—x(t) + P x(t) + P-i / x(t) dr = Bu(t), 
dt Jto 

( 6A ) y(t) = Du(t) + Lx(t), 



x(t ) = Xq. 
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Here, P_ 1; P , P x £ C n " xn °, B £ C n ° xm , D £ C pxm , and L £ C pxn ° are given 
matrices, to £ R is a given initial time, and xq £ C"° is a given vector of initial 
values. 

We stress that the matrix Px is allowed to be singular, and thus the first equa- 
tion in l|6.1|l is indeed a system of integro-DAEs in general. Our only assumption 
on the matrices P-i , Po, and Pi in i|6.1[l is that the hq x no-matrix- valued rational 
function 

Q(s) := sPi +P Q + -P-i, s £ C, 
s 

is regular, i.e., the matrix Q(s) is singular only for finitely many values of s £ C. 

In practical applications, the matrices Po and P\ are usually sparse, while the 
matrix P_i is not always sparse. However, in those cases where the matrix P_i 
itself is dense, P-i is given as a product of the form 

(6.2) P_i = F x GFf 
or 

(6.3) P_i = PiG _1 P 2 H , with nonsingular G, 

where Fx, F 2 £ C"° x "° and G £ C" oX ™ are sparse matrices. We stress that 
in the case l|6.2f) . the matrix G is not required to be nonsingular. In particular, 
for any matrix P_i £ c«oxri 0j there is always the trivial factorization l|6.2fl with 
Pi = F2 = I no and G = P_i. Therefore, in the following, we assume that the 
matrix P_i in (|6.1() is given by a product of the form (|6.2|l or (|6.3|l . 

6.2 Equivalent first-order formulations. 

In analogy to the case of higher-order systems l|5.1|l . any system of integro- 
DAEs of the form Hfi.ljl is equivalent to a first-order system of the form H5.4JI . In 
this subsection, we present such equivalent first-order formulations. 

We distinguish the two cases (I6.2f> and (|6.3|l . First assume that P_i is given 
by (|6.2|) . In this case, we set 

(6.4) zx(t):=x(t) and z 2 {t) := P-f / x(t)oIt. 

Jt 

By (|6.2|l and 16. 411 . the first relation in (|6.1|) can be rewritten as follows: 

(6.5) Piz'x(t) + Pazx(t) + F 1 Gz 2 (t) = Bu{t). 
Moreover, l|6.4|l implies that 

(6.6) z 2 (t)=F 2 H Zl (t). 

It follows from (|6.4|) - (|6.6|) that the system of integro-DAEs (|6.1|l (with P_i given 
by §6.'2\i ) is equivalent to a first-order system l|5.4|l where 



z{t) 

(6.7) 

V 
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Next, we assume that P_i is given by (|6.3[l . In this case, we set 

(6.8) Zi{t):=x(t) and z 2 (t) := G" 1 F 2 H f x(t)cIt. 

J t 

By and l|6~£)l . the first relation in (|6~T|) can be rewritten as follows: 

(6.9) ^1*1 (*) + P zi(t) + F lZ2 (t) = Bu(t). 
Moreover, l|6.8|l implies that 

(6.10) Gz' 2 (t) = F 2 H Zl (t). 

It follows from (|6.8|l - (|6.1()|) that the system of integro-DAEs (j6.ll) (with P_i 
given by H6.3jl ) is equivalent to a first-order system (|5.4|) where 



z{t) 



(6.11) 



-*l(t)- 




x 




7 Z ; — 






C:=[L 0], B 



V:=D, A 



-Po -Pi 
Pf 



£ 



Pi 
G 



6.3 Pade and Pade-type model reduction. 

Just as in Subsection 15.31 based on the equivalent first-order formulations 
defined in (|6.7|l . respectively l|6.11|l . one can again introduce the notion of Pade 
and Pade-type reduced-order models of systems of integro-DAEs (|6.1|l . In this 
case, we assume that the expansion point So £ C is chosen such that So ^ and 
the matrix 

(6.12) Q := Q(« ) = s Pi + Po + — P-i 

so 

is nonsingular. One readily verifies that this condition is equivalent to the non- 
singularity of the matrix sq £ — A. The matrices that induce the relevant block- 
Krylov subspaces JC n (A4,lZ) for Pade and Pade-type model reduction are again 
given by 

(6.13) M := (s £-A)~ 1 £ and K := (s a £ - Ay^, 

where A, £, and B are now the matrices defined in (|6.7|) . respectively (|6.11|) . 

6.4 Structure of the matrices M. and 1Z. 

In this subsection, we describe the structure of the matrices M. and P.. 

Again, we distinguish the two cases Q6.2[l and (|6.3fl . First assume that P_i is 
given by l|6.2|l . Using the definitions of A, £ , B in l|6.7|l . and of Q in (|6.12|l . one 
can show that the matrices (I6.13f) have the representations 



(6.14) 



M 



K 



In 

-F? 

so 2 

-F 2 H 

So 2 





ij. 
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The matrices A4 and 1Z in (|6.14l) are a special instance of the class of matri- 
ces H3.8I1 . with the integers and matrices (13.911 chosen as follows: 



2, ni := n a , 


n 2 := 






so 




:= _ 


1 




0, d 2 := — , 


R := 


so 





1 

— ( 

so 



Next, we assume that P_i is given by l|fi.3jl . Using the definitions of A, £, B 
in (|6.11|) . and of Qq in I|tj.l2fl . one can show that the matrices (|6.13[1 have the 
representations 



(6.15) 



M = 



n = 



—G~ 1 F^ 1 

SO z 

I no 

— G~ 1 Fi { 

s 




o ±h 



Note that the matrices A4 and 1Z in (|6.15|) are a special instance of the class of 
matrices (|3.8|) . with the integers and matrices l|3.9|l chosen as follows: 

I := 2, m := n , n 2 := n , 

C«:=J no , ; = L G ^Ff , 

so 

MW^Qo 1 ^, MP) := --Qo l Fi, 

so 

o-i :=0, (7 2 := — , R:=Q^B. 
so 

Proofs of (|6.14|) and 1)6. 15[) are given in Appendix B. 



7 Concluding remarks. 

We have introduced two classes of structured matrices, which include the ma- 
trices of first-order formulations of higher-order linear dynamical systems as spe- 
cial cases. As our main results, we have shown that the block-Krylov subspaces 
induced by the matrices in theses classes exhibit special structures. Roughly 
speaking, for both classes, the associated structured block-Krylov subspaces 
consist of multiple copies of certain subspaces of the state space of the original 
higher-order system. Note that the dimension of the state space of the first-order 
formulation is I times the dimension of the original l-th-order system. Our re- 
sults show that in order to construct basis vectors for the block-Krylov subspaces 
of the higher-dimensional first-order state-space, it is sufficient to construct ba- 
sis vectors for certain subspaces of the lower-dimensional ^-th-order state space. 
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The problem of the efficient and numerically stable construction of basis vectors 
of these subspaces is beyond the scope of this paper. Such algorithms will be 
described in a forthcoming report. 
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Appendix A. 

In this appendix, we establish the representations (|5.14(l and (|5.15(l . To this 
end, we set 



(7.1) 



Pi 



i-i 

3=0 



0,1, 



In view of (|5.11|) and (|5.12l) . we then have 

(7.2) M^~p-ip h i = l,2,...,l, and P = P(s ). 

Using the definitions of A and £ in l|5.5|) . as well as (|7.1|l . one readily verifies 
that 



So £ — A 



(7.3) 





s I 


-I 



























SqI 


-I 


















A = 



































s a I 






-I 












. Pa 


Pi 




Pl-2 


Pl 




+ s Pi _ 












- 


-I 





o - 

























-/ 








sol 


/ 


























sol 


I 
















- 


I 

















-Pa 


Pi 


Pi 


... p l 


-l - 




. 




- 


-SqI 


/ 


, in view of i|7.2|). we 


have 
















-I 







o - 










M0- 1 ) 


Pa 


1 





-I 







































-I 




















-/ 


















Pi 


P2 




Pl-l- 




L o 







-I 
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By inverting the two factors on the right-hand side of (|7.3|) and multiplying the 
inverse factors (in reverse order) from the right by the matrix £ , respectively B, 
from H5.5fl . we obtain the relation 



M := (s 8 -A) 1 8 





I 









SqI 


i 







sp 


S I 


I 




s lll I 

- b Q 1 




S Q 1 


respectively 








n 


■■=( 


sq 8 - 



M« M( 2 ) M( 3 ) 
-7 
0-7 



... M « 




-I 



aY'b 



i 

SqI 

sp 



(P(s )) X B. 



The first relation is readily rewritten in the form (|5.14|) , and the second relation 
is just (|5.15() . Thus the proof is complete. 

Appendix B. 

In this appendix, we establish the representations (|6.14() and (|6.15() for the 
case that P_i is of the form (|6.2|) and 1)6. respectively. 
First assume that P_i is given by (|6.2|) . Using l|6.2fl . I|tj.7[l . and Q6.12p . one 

readily verifies that 

soPi+Po FiG 



Sq £ — A = 

It follows that 
(7.4) (s £-Ay 1 = 



Qq PiG 

SoP 



so Pi t 



1 T?H T 



In 







so 2 i "o 



Qq 




By multiplying (|7.4() from the right by the matrix £, respectively 1Z, from l|6.7|l . 
we obtain the relations stated in (|6.14l) . 

Next, we assume that P_i is given by Recall that the matrix G is 

nonsingular. In this case, we have 



s £ — A = 



s P 1 + Pq Pi 

-Ff s G 

Qq Pi 
s G 



— G _1 P. 

so 



1 PH T 
2 1 n 



KRYLOV SUBSPACES ASSOCIATED WITH HIGHER-ORDER SYSTEMS 



21 



It follows that 

(7.5) (soS-Ay 1 



so 



By multiplying (|7.5|) from the right by the matrix £, respectively 1Z, from JfTJJl, 
we obtain the relations stated in (16.151). 



